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ABSTRACT 

* 

Iterated  Function  Systems  (IFS)  fdfofiers  a  method 
of  describing  complicated  digital  files  with  a  small  set 
of  functions  exhibiting  fractal  properties.  In  coding 
an  image,  first  cover  it  with  contractive  affine  trans¬ 
formations  of  itself  and  then  save  the  coefficients  of 
the  transformations.  Decoding  is  performed  by  gen¬ 
erating  a  dynamical  system  whose  attractor  is  suit¬ 
ably  close  to  the  original  image.  The  amount  of  dis¬ 
tortion  is  dependent  on  the  quality  of  the  initial  cov¬ 
ering.  This  paper  will  describe  the  mathematics  of 
IFS.  thi.’  coding  and  decoding  of  a  digital  image  with 
IFS.  error  analysis  of  IFS  compression,  and  compar¬ 
ison  to  other  compression  techniques. 


1  Introduction 

Mandelbrot  coined  the  term  fractal  to  describe 
sets  that  demonstrate  detail  under  any  arbitrary 
magnification.  Mandelbrot  described  the  properties 
of  sets  with  non-integer  dimension,  fractal  sets  ,  and 
produced  many  examples  from  nature:  coastlines, 
clouds,  brownian  motion,  trees,  etc...  Human-made 
mechanisms  also  display  fractal  behavior:  the  stock 
market,  bouncing  balls,  dripping  faucets,  etc...  Man- 
delbrot^fflj^made  it  clear  that,  in  nature  fractal  ac¬ 
tion  has  a  limit  while  pure  mathematical  fractals  have 
structure  at  all  scales,  but  both  have  in  common  sfa- 
tislical  invariance  tinder  transformation  of  scale.  An 
IFS  generates  a  set  with  fractal  properties.  { )  s r,  ) 


1.2  Fractal  Generation 


{Avail  and/or 
Spaolal 


1.1  Properties  of  Fractal  sets 


One  method  of  generating  fractal  sets  is  by  start¬ 
ing  with  a  seed  pattern  which  is  then  scaled  and  re¬ 
peated  to  produce  the  global  set.  Another  method  is 
iterative  fractal  construction  which  is  the  way  that 
the  IFS  fractal  is  produced.  An  iterative  fractal  be¬ 
gins  with  the  selection  of  an  initial  value  A'o,  which  is 
the  input  to  a  function,  /( A'„).  The  resulting  func¬ 
tion  value,  A'i,  is  then  used  as  the  next  input  to  the 
function  with  the  outcome  also  applied  as  an  input 
to  the  function.  The  structure  of  this  mechanism  is 
a  feedback  loop  that  generates  a  sequence  of  points, 

A'o .  A' ! ,  AT . Y„,  where  A'rl+i  =  /( A'„).  For  this 

paper  A'„  =  (xn,y„)  £  R2.  The  overall  result  is  a 
Discrete-Dynamical  System  (DDS)  whose  geometri¬ 
cal  behavior  is  determined  by  the  properties  of  the 
generating  equations. 

1.3  Dynamical  Systems 

A  Dynamical  System  is  a  set  of  rules  that  govern 
the  behavior  of  points  in  a  well-defined  space.  Con¬ 
tinuous  dynamical  systems  can  be  transformed  into 
discrete  systems  through  application  of  the  Poincare 
map.  We  will  only  concern  ourselves  with  the  discrete 
case.  An  IFS  is  an  example  of  a  DDS.  Upper-case  , 
A'i,  refers  to  points  in  R~.  Lower  case  fit*,  t/i)  refers 

to  the  coordinates  of  the  point,  A'i.  We  will  look  at 

*) 

sequences  of  points  in  R"  that  begin  with  an  initial 
point  and  follow  an  orbitAinder  the  guidance.bf  rules 
determined  by  a  family  of  functions.  The  orj>it  is 
formed  bv  the  iteration  6T.  the  functions. 


Fractal  sets  are  self-referencing,  producing  similar 
structure  at  smaller  and  smaller  scales.  This  prop¬ 
erty  causes  many  fractal  sets  to  be  continuous  but 
non-difTerentiable.  This  property  can  be  measured 
with  the  fractal  dimension ,  D,  a  scalar  that  repre¬ 
sents  the  limit  of  the  number  of  discs  of  diameter  <, 
N(e),  to  cover  the  set  as  c  approaches  zero. 

D  =  lim  ~ 7—7-7.  D  =  fractal  dimension  (l) 

f-o  ln(l/e) 


1.4  Notation  of  DDS 

The  rule  A't+i  =  /(AT )  for  generating  a  sequence 

ry 

of  points,  A'o,  A'i,  AT,...,  A'n  £  R",  starts  with 
the  initial  point  A'o-  The  next  points  are:  A'i  = 
/(A'o),  AT  =  /(AT),...  and  so  on.  The  function  f 
has  2  variables  ,  tr*  and  y*,  which  are  the  coordi¬ 
nates  of  the  point  A'*.  This  is  the  iteration  process 
which  takes  the  output  of  the  function  at  each  step 


and  feeds  it  back  in  as  input.  This  feedback  progress 
is  what  generates  complex  behavior  from  a  set  of 
simple  rules.  In  function  notation  the  iterates  are: 
*o,  /(-Vo),  f(f(X o)),  /(/(/(Vo))),  ...  OR 

V0,  /(Vo),  /2(V0),  /3(Vo), ...,  /n(V0).  Both  no 
tations  express  the  orbit  of  the  original  point,  A'o. 
The  latter,  with  superscripts,  gives  the  number  of 
iterates  for  Vo  to  arrive  at  another  point  in  the  se¬ 
quence. 

1.5  Definition  of  Attractor  of  a  DPS 

Of  interest  is  the  long-term  behavior  of  the  dynam¬ 
ical  system.  If  the  orbit  of  the  dynamical  system  con¬ 
verges  to  some  local  neighborhood  and  once  entering 
this  neighborhood,  stays  for  infinite  time  we  say  that 
the  orbit  has  converged  to  an  Attractor.  Attractors 
are  typically  points,  periodic  orbits,  or  quasi-periodic 
cycles.  If  the  attractor  is  none  of-the-above,  then  it 
is  termed  a  Strange  Allraclor  which  often  has  fractal 
properties. 

Definition  1  (Attractor  )  P  is  an  allraclor  of  a 
DDS  if  there  exists  an  open  neighborhood  of  P.  V. 
such  that  if  X  €  U,  X  £  P.  —  lim n—ao  fn(  X)  =  P 

l.d  Chaos  in  a  DDS 

DDS’s  with  attractors  possessing  complex  geomet¬ 
rical  behavior  are  commonly  Strange  Attractors  with 
fractal  properties.  Systems  with  strange  attractors 
exhibit  the  properties  of  chaos.  The  IFS  attrac¬ 
tors  are  commonly  strange  attractors  and  are  Chaotic 
Systems  that  arise  from  the  iteration  of  determinis¬ 
tic  sets  of  functions.  Following  the  orbit  of  a  DDS. 
once  the  sequence  of  points  enters  the  boundary  of 
the  Strange  Attractor  it  undergoes  a  transition  from 
order  to  chaos.  The  orbit  of  a  DDS  once  it  enters  the 
attractor  is  chaotic  in  two  ways.  If  the  initial  point 
is  perturbed  even  a  small  amount  then  the  resulting 
orbit  will  eventually  diverge  from  the  original  (Sensi¬ 
tive  Dependence  on  Initial  Conditions).  Additionally 
the  orbit  within  the  attractor,  given  enough  time,  will 
come  arbitrarily  close  to  every  interior  point  ( Topo¬ 
logical  Transitivity). 


2  Iterated  Function  Systems 

For  image  compression  an  Iterated  Function  Sys¬ 
tem  (IFS)  is  constructed  to  have  a  unique  attractor 


that  in  most  cases  is  chaotic  with  fractal  properties. 
Hutchinson  [2]  and  Barnsley  [1]  developed  the  con¬ 
cepts.  An  IFS  is  a  set  of  contractive-affine  transfor¬ 
mations  in  R2.  Associated  with  the  IFS  is  a  unique 
attractor,  such  that  any  random  sequence  of  the  IFS’s 
affine-contractive  mappings  will  converge  to  the  at- 
tractor  upon  iteration  in  R“. 

2.1  Definition  of  Affine  Map 

Definition  2  (Affine  Map  in  R2) 

9  9 

.4  Transformation  IF  :  R“  - R", 


9 

Affine  maps  in  R“  perform  the  operations  of  ro¬ 
tation.  translation,  and  scaling  on  points  A't  = 

9 

(ji ;.’jk)  £  R"  The  2  x  2  Matrix  (a.b.c.d)  accom¬ 
plishes  rotation  and  scaling.  The  2  x  1  Matrix  (e.f) 
performs  translation  (a.b.c.d.e.f  £  R). 

2.2  Definition  of  Contractive  Affine  Map 

A  contractive  affine  map  in  R“  brings  points  closer 
together.  To  define  an  IFS  in  R“  we  form  a  set 
of  contractive-affine  maps.  The  contractive  property 
guarantees  that  the  attractor  will  be  well  behaved 
and  non-divergent.  The  IFS  allows  encoding  a  given 
image  as  a  set  of  transformations.  The  original  im¬ 
age  can  be  discarded,  it’s  information  represented  as 
the  coefficients  of  the  affine  transformations.  This  is 
the  basis  for  IFS  compression  of  digital  images.  To 
find  the  transformations  that  will  produce  a  given 
image  we  apply  Barnsley's  Collage  Theorem  which 
describes  a  covering  whose  IFS  will  have  a  unique 
attractor  suitably  close  to  the  original  image. 

Definition  3  (Contractive  Affine  Map  in  R“) 
Let  d(X,  Y)  be  a  distance  function  defined  for  all  X,  Y 

9 

in  R“.  Let  s  be  0  <  s  <  1,  s— Contractive  factor, 
THEN  a  contractive  affine  map  W,  :  R“  —  R2, 
satisfies  d{\Vi(X),\V,(Y))  <  sd(X,Y)  for  all  X.Y  in 

R2. 

2.3  Definition  of  IFS 

An  IFS  is  defined  as  a  finite  set  of  contractive 
affine-mappings  in  R2  that  map  the  space  into  itself. 
The  contractivity  factor  of  an  IFS  is  the  maximum 


of  the  individual  contractive  factors  of  the  mappings. 
This  definition  guarantees  that  each  IFS  has  a  unique 
attractor.  However,  it  is  not  the  case  that  each  at¬ 
tractor  has  a  unique  IFS. 

2.4  Collage  Theorem 

The  Collage  Theorem  [1]  says  that  given  an  arbi¬ 
trary  image  defined  in  a  closed  bounded  space,  such 
as  a  computer  screen,  we  can  construct  an  IFS  with  a 
unique  attractor,  that  we  can  force  to  be  arbitrarily 
close  to  the  original  image. 

Theorem  1  (Barnsley  '85)  Let  {IF  \V\  £ 

R2,  i  =  i,  ...,n}  -  IFS,  Let  L  C  R",  ivith 
d(L,  U  IF, (I))  <  e,  c  >  0,  T H EX  d(L,  .4)  < 
<r  /(I  —  s),  Where  .4  —  Attractor  of  IFS,  s  =  Con¬ 
tractual y  Factor. 

The  Collage  Theorem  [1]  states  that  the  inverse  prob¬ 
lem  can  be  solved.  One  method  is  to  cover  an  image 
with  cont  ractive-affine  mappings  of  itself.  Then  solve 
the  transformations  to  obtain  the  IFS.  Once  the  IFS 
is  constructed  the  attractor  is  generated  by  assigning 
a  probability  weighting  to  each  map  then  following 
a  random  orbit  that  will  eventually  converge  to  the 
attractor.  If  the  covering  was  done  with  care  it  will 
be  suitably  close  to  the  original  image. 

2.5  Collage  Theorem  algorithm 

For  fast  image  compression  the  best  situation 
would  be  an  automatic  algorithm  for  generating  the 
IFS  of  an  arbitrary  digital  image.  Unfortunately  it 
is  difficult  to  implement  such  a  process  because  of 
the  numerous  degrees  of  freedom  possible  in  covering 
with  the  affine  transformations.  The  example  in  this 
paper  was  done  by  tiling  the  image  with  contracted 
copies  of  itself  controlled  by  affine  maps.  The  cover¬ 
ing  was  done  by  issuing  commands  from  the  keyboard 
and  mouse  that  applied  the  affine  maps  on  the  com¬ 
puter  screen.  Once  the  ensemble  of  maps  adequately- 
covered  the  image  to  be  compressed,  they  were  saved 
in  a  file  to  be  used  in  generating  the  attractor. 

3  IFS  Attractor 

Each  IFS  has  a  unique  attractor,  but  the  reverse 
is  not  true.  Given  an  IFS,  it’s  attractor  can  be 
found  by  a  random  iteration  starting  with  the  initial 


point.  The  beginning  iterations  may  be  discarded 
since  they  represent  a  transient  containing  no  infor¬ 
mation.  Once  the  sequence  of  iterations  enters  the 
attractor  it  will  never  leave. 

3.1  Random  Algorithm  for  IFS  Attractor 

The  random  algorithm  starts  with  an  arbitrary  ini- 

o 

tial  point  .Vo  =  (xo,yo)  €  R".  One  of  the  mappings 
of  the  IFS,  Wk,  is  then  selected  at  random  and  the 
next  point,  AY  is  found  by  evaluating  IFi(Ao)  =  AY 
Hence,  =  IFm(Ai)  with  IFm  picked  at  random. 
Successive  points  are  generated  similarly. 

Let  {IF  :  IF,  €  R2,i  =  1, ....  n}  =  IFS,  VlF,,(i  = 
1 . ...,  n),  3.P,  —  P>  =  1  (see  sec-  3-4)  A°w 

define  a  sequence  of  points  {A’, }J‘=1  —  A'„  = 

IF*; ( A"„ _  i )  with  the  constraint  P ( I )  =  P*.  This 
algorithm  generates  a  discrete  dynamical  system 
Xq,  Xi.  AY  ...,  Xn  that  converges  to  a  unique  attrac¬ 
tor.  Each  point  in  the  sequence  is  generated  by  one 
of  the  maps  picked  at  random.  As  long  as  the  ini¬ 
tial  point  is  within  the  IFS's  basin  of  attraction  then 
the  DDS  will  eventually  converge  to  the  attractor. 
The  number  of  iterations  for  the  random  sequence  to 
converge  to  the  attractor  depends  on  the  distance  of 
the  initial  point  from  the  boundary  of  the  IFS's  at¬ 
tractor.  Generally  the  first  50  iterations  represents  a 
transient  and  should  be  discarded. 

3.2  Deterministic  Algorithm  for  IFS  Attractor 

An  alternate  method  of  finding  the  attractor  of  an 
IFS  is  to  simultaneously  apply  all  the  mappings,  of 
the  IFS,  to  an  initial  set  of  points  rather  than  just  one 
point.  In  this  algorithm  no  probabilities  are  assigned 
to  each  map  causing  all  the  functions  to  contribute  to 
the  attractor  equally.  This  method  is  slower  than  the 
random  algorithm,  unless  programmed  on  a  parallel 
processor,  and  has  less  versatility  in  producing  dif¬ 
ferent  textures  in  the  interior  of  the  attractor,  since 
the  distribution  of  the  mappings  is  uniform  (see  sec. 
3.4). 

3.3  Finding  the  IFS 

To  apply  the  collage  theorem  in  R“,  cover  the  tar¬ 
get  image  with  contractive-affine  copies  of  itself  then 
solve  for  the  coefficients  that  map  the  original  image 
to  each  of  the  tiles.  For  example  consider  the  affine 
function  necessary  to  map  a  large  triangle,  T,  to  a 
contractive  copy  of  itself,  t.  Identify  3  tie  points  on 


T  and  the  3  corresponding  tie  points  on  t.  Each  point 
of  T,  (xktyk),  is  mapped  to  a  point  of  t,  {x'k,y'k)  (k 
=  1,2,3),  by  the  contractive-affine  mappings: 


With  3  tie  points  the  affine  map  can  be  represented 
as  6  linear  equations,  which  can  be  partitioned  into  2 
systems  of  simultaneous  linear  equations,  of  3  equa¬ 
tions  in  3  unknowns,  sufficient  to  solve  for  the  coeffi¬ 
cients:  a,b,c,d,e,and  f. 

Solve  for  a,  b,  and  e  as  a  system  of  linear  equations. 


■fi  y l  1  \  /  a  \ 

it-  1  J  H 

*3  i/3  1  /  V  e  / 

Solve  for  c,  d,  and  f  similarly. 


(3) 


■Cl  yi  1\  fc\  ( y[  \ 

x-1  V2  1  d  =  !/i  (‘t) 

*3  2/3  i)  \fj  \y'J 

Each  mapping  contained  in  the  IFS  for  R"  is  repre¬ 
sented  by  6  numbers:  a,b,c,  and  d  which  denote  ro¬ 
tation  and  scaling,  while  e  and  f  signify  translation. 
If  there  are  n  mappings  then  the  IFS  is  encoded  with 
6n  coefficients.  To  generate  the  attractor  of  the  IFS, 
equivalent  to  decoding,  a  probability  weighting  is  as¬ 
signed  to  each  map. 


3.1  Assigning  probabilities  to  IFS 


Suppose  there  are  n  mappings  in  the  IFS,  then  to 
use  the  random  algorithm  to  generate  the  attractor 
it  is  necessary  to  assign  n  probability  weightings,  one 
to  each  map.  The  sum  of  the  probabilities  should  be 
one. 

Determine  the  probability,  P,,  of  each  U7,  by  taking 
the  absolute  value  of  the  determinant  of  the  rotation- 
scaling  matrix.  This  weighting  is  most  accurate  if 
the  coverings  do  not  overlap.  The  sum  is  normalized 
to  unity  by  dividing  by  the  absolute  sum  of  all  the 
probability  weightings.  This  insures  that  each  map 
is  randomly  selected,  directly  proportional  to  the  in¬ 
formation  it  contributes  to  the  attractor. 
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3.5  IFS  Probability  Distribution 


Assigning  a  probability  to  each  map  of  the  IFS 
determines  the  distribution  of  points  in  the  inte¬ 
rior  of  the  attractor.  Lowering  the  probability  of  a 
map  lowers  the  frequency  of  points  visited  by  that 
map.  Changing  the  probabilities  does  not  change  the 
boundaries  of  the  attractor,  what  changes  is  the  dis¬ 
tribution  of  the  attractor’s  interior  points.  The  at¬ 
tractor’s  boundaries  remain  invariant  as  long  as  the 
affine-map  coefficients  remain  the  same.  By  count¬ 
ing  the  total  number  of  iterari^nc  that  visit  the  at¬ 
tractor  and  the  number  that  visit  each  pixel  a  his¬ 
togram  of  the  DDS  density  is  generated.  The  rela¬ 
tive  density. rdense,  of  each  pixel  would  be:  rde.nse  = 
N(i,  j)/Iter,  with  N(i,j)  =  total  iterations  at  pixel 
location  (i.j)  and  Iter  =  total  number  of  iterations 
inside  the  attractor.  Once  rdense  is  computed  a  color 
lookup  table  could  be  constructed  to  assign  color  val¬ 
ues  to  the  attractor  based  on  the  histogram.  Textures 
could  also  be  generated  by  reassigning  the  proba¬ 
bilities  to  generate  a  different  histogram  with  cor¬ 
responding  density. 


4  Measurements  of  IFS 


To  measure  the  error  between  the  original  image. 
L,  and  the  IFS's  attractor,  A,  two  methods  are  used 
in  this  paper.  The  first  is  relative  difference  rdiff 
and  the  second  is  the  Hausdorff  distance  hd  between 
L  and  A.  Both  methods  assume  monochrome  digital 
images.  The  rdiff  measures  points  present  in  L  but 
not  in  A  and  is  dimensionless.  The  rdiff  measure 
would  be  0  for  an  errorless  compression,  1  for  the 
worst-possible  case. 

d'  f  f  —  (  num^er  points  in  \L  -  A|  \  1/12 
1 J  V  total  number  of  points  in  L  / 

The  Hausdorff  distance  is  a  metric  between  2  sets  in 
a  metric  space,  in  our  case  the  space  rL  The  Haus¬ 
dorff  metric  is  found  by  first  finding  the  minimum  of 
the  distance  from  all  the  points  in  L  to  the  points 
of  A.  Next  the  minimum  of  the  distance  from  all  the 
points  in  A  to  the  points  of  L  is  computed.  The  max¬ 
imum  of  these  2  minimums  is  the  Hausdorff  distance. 
Because  the  metric  space  the  algorithm  works  in  is  a 
computer  screen,  the  hd  units  are  in  pixels. 


hd(L,A)  =  Max  (Min(<f(L,  A))  ,  Min (d(A,  L))) 


Where  d  =  distance  function 

4.1  IFS  Compression 

A  computer  experiment  was  conducted  with  the 
target  image  being  a  digitized  map  of  the  U.S.A.. 
The  Collage  Theorem  was  applied  and  50  contrac¬ 
tive  affine  transformations  constructed  that  covered 
the  original  image.  Associated  probability  weight¬ 
ings  were  computed,  as  in  sec.  3.4.  The  random 
algorithm  was  used  to  generate  the  attractor  of  the 
IFS.  The  compression  results  are  measured  in  2  ways: 

total  of  numbers  to  describe  L 

ratnum  =  - ; — ; - - - - - - -  (7) 

total  ot  numbers  t.o  describe  A 

,  number  of  bvtes  in  L 

ratbyt  =  - - - - —  8) 

number  of  bytes  in  A 

For  example,  if  L  could  be  described  with  1500 
(x.y)  coordinates  and  A  s  IFS  had  50  affine  map¬ 
pings  then  ratnum  -  (200  *  2 }/( 6  *  50)  =  10.  Addi¬ 
tionally  if  L  is  5000  bytes  and  A  is  1000  bytes  then 
ratbyt  =  5000/1000  =  5. 

4.2  Results  of  IFS  Computer  Experiment 

As  a  comparison  the  commonly  used  Ziv-Lempel- 
VV'elch  compression  algorithm  (ZLW)  [5]  [4]  was  used 
on  the  same  image. 


Compression 

IFS 

ZLW 

ratnum 

10/1 

N.A. 

ratbyt 

100/1 

5/1 

•rdifF 

0.099 

0.0 

hd 

6.4  pixels 

0.0  pixels 

For  this  image.  IFS  supplies  better  compression 
than  ZLW  but  nof  without  a  loss  in  image  fidelity. 
The  ZLW  algorithm  gives  lossless  compression  while 
the  IFS  compression  introduces  distortion  in  transla¬ 
tion,  scaling,  and  rotation.  To  decrease  the  error  of 
the  IFS  compression  more  transforms  need  to  be  used 
which  would  decrease  the  compression  ratio.  Each 
transform  contributes  6  coefficients  to  the  IFS  code. 
The  ideal  IFS  optimization  would  minimize  the  error 
and  with  the  minimum  number  of  maps. 

5  Summary 

Compression  with  IFS  is  accomplished  by  finding 
a  set  of  contractive-affine  maps  that  cover  the  orig¬ 


inal  set,  an  application  of  Barnsley’s  Collage  Theo¬ 
rem.  The  6  parameters  per  map  are  saved  as  the  code 
for  the  compression.  To  reconstruct  the  original  im¬ 
age,  a  probability  weighting  is  assigned  to  each  map. 
The  weighting  is  determined  by  the  information  each 
map  contributes  to  the  attractor  and  is  computed 
strictly  from  the  parameters.  To  generate  the  attrac¬ 
tor  an  initial  point  is  selected  which  is  used  as  input 
to  one  of  the  maps  selected  at  random.  All  the  suc¬ 
cessive  points  are  found  by  iteration  of  the  maps  se¬ 
lected  by  random.  This  generates  a  random  sequence 
of  points  that,  after  settling  down,  converges  to  the 
attractor.  The  attractor  of  this  discrete-dynamical 
system  will  be  within  epsilon  distance  of  the  original 
image.  Epsilon  is  determined  by  the  quality  of  the 
covering.  This  compression  method  works  best  with 
images  that  display  self-similarity,  such  as  coast  lines. 
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